Partial Diffusion Markov Model of Heterogeneous TCP Link: Optimization with Incomplete Information
نویسندگان
چکیده
The paper presents a new mathematical model of TCP (Transmission Control Protocol) link functioning in heterogeneous (wired/wireless) channel. It represents controllable, partially observable stochastic dynamic system. system state describes the status modeled and expresses it via an unobservable controllable MJP (Markov jump process) with finite-state space. Observations are formed by low-frequency counting processes packet losses timeouts high-frequency compound Poisson process acknowledgments. information transmission through TCP-equipped channel is considered control problem incomplete information. main idea to solve impose separation principle on problem. proposes framework algorithmic support implement solution. includes solution complete information, diffusion approximation observations, filtering given observations multiplicative noises, numerical scheme algorithm. also contains results comparative study proposed state-based congestion algorithm contemporary versions: Illinois, CUBIC, Compound, BBR (Bottleneck Bandwidth RTT).
منابع مشابه
Learning in Markov Games with Incomplete Information
The Markov game (also called stochastic game (Filar & Vrieze 1997)) has been adopted as a theoretical framework for multiagent reinforcement learning (Littman 1994). In a Markov game, there are n agents, each facing a Markov decision process (MDP). All agents’ MDPs are correlated through their reward functions and the state transition function. As Markov decision process provides a theoretical ...
متن کاملOn a Markov Game with Incomplete Information
We consider an example of a Markov game with lack of information on one side, that was first introduced by Renault (2002). We compute both the value and optimal strategies for a range of parameter values. ∗MEDS Department, Kellogg School of Management, Northwestern University, and Département Finance et Economie, HEC, 1, rue de la Libération, 78 351 Jouy-en-Josas, France. e-mail: j-horner@kello...
متن کاملPartial Plan Recognition with Incomplete Information
This work explores the benefits of using user models for plan recognition problems in a real-world application. Selfinterested agents are designed for the prediction of resource usage in the UNIX domain using a stochastic approach to automatically acquire regularities of user behavior. Both sequential information from the command sequence and relational information such as system’s responses an...
متن کاملData-driven Inverse Optimization with Incomplete Information
In data-driven inverse optimization an observer aims to learn the preferences of an agent who solves a parametric optimization problem depending on an exogenous signal. Thus, the observer seeks the agent’s objective function that best explains a historical sequence of signals and corresponding optimal actions. We formalize this inverse optimization problem as a distributionally robust program m...
متن کاملEvaluating Multipath TCP Resilience against Link Failures
Standard TCP is the de facto reliable transfer protocol for the Internet. It is designed to establish a reliable connection using only a single network interface. However, standard TCP with single interfacing performs poorly due to intermittent node connectivity. This requires the re-establishment of connections as the IP addresses change. Multi-path TCP (MPTCP) has emerged to utilize multiple ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematics
سال: 2021
ISSN: ['2227-7390']
DOI: https://doi.org/10.3390/math9141632